Smart home control system

ABSTRACT

There is provided a smart home control system including a host, at least one sensor, a plurality of controlled devices and an informing device. The host identifies entering and leaving of family members according to detection results of the at least one sensor, and controls on/off of the controlled devices or informs a specific family member by the informing device to execute agenda according to a member ID of a family member who is identified to enter or leave the house. When identifying that one agendum is unable or forgotten to be executed by the specific family member, the host further rearranges the agendum.

CROSS REFERENCE TO RELATED APPLICATION

The present application is a continuation-in-part application of U.S.Ser. No. 16/398,778, filed on Apr. 30, 2019, the disclosure of which ishereby incorporated by reference herein in its entirety. The presentapplication is also a continuation-in-part application of U.S. Ser. No.16/683,946, filed on Nov. 14, 2019, the disclosure of which is herebyincorporated by reference herein in its entirety.

BACKGROUND 1. Field of the Disclosure

This disclosure generally relates to a smart home control system and,more particularly, to a smart home control system that turns on and offmultiple electronic devices or informs a specific family member toexecute recorded agenda according to the entering and leaving of familymembers.

2. Description of the Related Art

The smart home is one part of developing a smart city. However, inaddition to basic controls of home appliances and lamps, it is also animportant issue in a smart home to perform controls corresponding todifferent family members because different family members generally havedifferent requirements. Besides, when multiple different events aredetected, if the system can identify the relationship between themultiple different events and actively give a suggestion to deal withthe related events together, performance of the smart home can befurther improved, thereby increasing the life convenience.

Accordingly, the present disclosure provides a smart home control systemthat performs the indoor control or message prompting according to theID of a member who enters or leaves the house to allow the smart home tobe more user-friendly.

SUMMARY

The present disclosure provides a smart home control system thatidentifies the relationship between recorded agenda and current events,and informs a specific member to execute the agenda related to thecurrent event to improve the user experience of the smart home.

The present disclosure further provides a smart home control system thatactively rearranges an assigned agendum when identifying that theassigned agendum is unable to be accomplished.

The present disclosure provides a smart home control system including amemory, multiple sensors and a host. The memory is configured to recordmultiple agenda each being recorded using an item code, which includes amember bit, a category bit, a temporal bit, a position bit and an assignbit. The host is coupled to the memory and the multiple sensors, andconfigured to give a new item code of a new agendum to be added in thememory when one of the multiple sensors detects the new agendum, give anevent code of a leaving event when the leaving event is recognized,compare the event code with recorded multiple item codes to determine arelated agendum of the leaving event among the multiple agenda andupdate the assign bit of the related agendum, and rearrange the relatedagendum when identifying, according to an external sensor, that therelated agendum is not executed.

The present disclosure further provides a smart home control systemincluding a memory, multiple sensors and a host. The memory isconfigured to record multiple agenda each being recorded using an itemcode, which includes a member bit, a category bit, a temporal bit, aposition bit and an assign bit. The host is coupled to the memory andthe multiple sensors, and configured to give an event code of a leavingevent when the leaving event is recognized according to one of themultiple sensors, compare the event code with recorded multiple itemcodes to determine a related agendum of the leaving event among themultiple agenda and update the assign bit of the related agendum, andrearrange the related agendum when identifying, according to an externalsensor, that the related agendum is not executed.

In the present disclosure, the agenda include items triggered or nottriggered by a member. For example, detecting an object storage at homeby a sensor is considered not being triggered by a member, accessingcontent in an electronic calendar may be considered being triggered by amember, and analyzing the conversation of family members is consideredbeing triggered by a member. The agenda include, for example, at leastone of purchasing objects, people contact, paying bills, carryingobjects, proceeding positions or the like.

In the present disclosure, the current event is generally triggered by afamily member, e.g., including family member exiting and family memberhaving a phone call.

BRIEF DESCRIPTION OF THE DRAWINGS

Other objects, advantages, and novel features of the present disclosurewill become more apparent from the following detailed description whentaken in conjunction with the accompanying drawings.

FIG. 1 is a schematic block diagram of a smart home control systemaccording to a first embodiment of the present disclosure.

FIG. 2 is a schematic diagram of correspondence relationship in a smarthome control system according to a first embodiment of the presentdisclosure.

FIG. 3 is a schematic block diagram of a smart home control systemaccording to a second embodiment of the present disclosure.

FIG. 4 is a flow chart of an operating method of a smart home controlsystem according to a second embodiment of the present disclosure.

FIG. 5 is a flow chart of an operating method of a smart home controlsystem according to a third embodiment of the present disclosure.

FIG. 6 is a schematic diagram of an operating method of a smart homecontrol system according to a third embodiment of the presentdisclosure.

DETAILED DESCRIPTION OF THE EMBODIMENT

It should be noted that, wherever possible, the same reference numberswill be used throughout the drawings to refer to the same or like parts.

The smart home control system of the present disclosure is used toidentify the entering and leaving of a family member according todetection results of at least one sensor, and to control the on/off orstrength of a plurality of controlled devices or to inform a specificfamily member to execute recorded agenda by an informing deviceaccording to a ID of the family member who is identified to enter orleave the house.

Referring to FIG. 1, it is a schematic block diagram of a smart homecontrol system 100 according to a first embodiment of the presentdisclosure. The smart home control system 100 includes a host 11, amemory 12, at least one sensor 13 (one sensor being shown herein, butnot limited to), a plurality of control switches 141 to 14N and an inputdevice 15. The plurality of control switches 141 to 14N are, forexample, electronic switches or valves to perform at least one ofturning on/off home appliances, turning on/off a security system,turning on/off lamps, changing operating strength of home appliances,changing brightness of lamps and opening/closing windows and doors.

The memory 12 includes volatile memory and/or non-volatile memory, andis used to previously record a correspondence relationship betweenmultiple family members and on/off of the plurality of control switches141 to 14N. For example, the correspondence relationship is set in asetting phase by the family members, e.g., changing and setting using ahuman machine interface of the input device 15, wherein the input device15 includes, for example, at least one of a mouse device, a keyboard, ajoystick, a display screen, a microphone (e.g., speech agent), a touchdevice or the like. In some aspects, all or a part of the input device15 is embedded in the host 11.

Referring to FIG. 2, it is a schematic diagram of the correspondencerelationship in a smart home control system 100 according to a firstembodiment of the present disclosure. The memory 12 records information(shown as state indication in FIG. 2) of whether each of the familymembers is at home or not. For example, if one family member is at home,a digital value (e.g., shown as 1) having at least one bit is used toindicate his/her state; whereas, if one family member is not at home, adigital value (e.g., shown as 0) having at least one bit is used toindicate his/her state, wherein whether one family member is at home ornot is confirmed automatically by the host 11 according to the detectionresult of the sensor 13 (an example being given below). In otheraspects, whether one family member is at home or not is set by using theinput device 15, e.g., pressing a key, through conversation or clickingan icon on a graphical interface.

The correspondence relationship includes, for example, the relationshipbetween in/out (or enter/leave) of a member with a control switch setand/or the relationship between a combination of staying members (orabsent member) and a combination of control switches, as shown in FIG.2. For example, when a male member enters or leaves the house, a firstcontrol switch set is turned on/off; when a female member enters orleaves the house, a second control switch set is turned on/off; whenonly elders and children are at home (i.e. staying members), a firstcombination of control switches is activated; whereas, when nobody is athome, a second combination of control switches is activated. Some familymembers are set not to activate any control switch, e.g., children. Eachcontrol switch set or combination of control switches includes at leastone control switch.

The sensor 13 is used to acquire activity data of multiple familymembers, and transmit the acquired activity data to the host 11 for theentering/leaving identification, voiceprint identification and facerecognition. The sensor 13 includes, for example, a CCD image sensor, aCMOS image sensor, a thermal sensor, an audio sensor and radio sensor(e.g., RFID) or other sensors capable of acquiring data to be used of IDrecognition and in/out identification. For example, if the sensor 13 isan audio sensor (e.g., a microphone), the activity data is contained inthe acquired voice data; if the sensor 13 is an image sensor, theactivity data is contained in the acquired image frame; and if thesensor 13 is a thermal sensor, the activity data is contained in theacquired thermal image. To detect the entering and leaving of a member,the sensor 13 is preferably arranged at an entrance or at a positioncapable of monitoring at least the condition of the entrance, but thepresent disclosure is not limited thereto. If the sensor 13 is an audiosensor, it may be arranged at anyplace that can receive the membervoice.

In some aspects, the sensor 13 includes an application specificintegrated circuit (ASIC) or a digital signal processor (DSP) thatperforms the identification according to the activity data at first andthen sends the identified result (e.g., indicated by at least one bit)to the host 11 for controlling the corresponding control switches.

The host 11 is selected from various fixed or movable computers thathave calculating ability, e.g., a personal computer, desktop computer,notebook computer, tablet computer, security server or the like withoutparticular limitations. The host 11 is coupled (e.g., wired or wireless)to the memory 12 and the sensor 13 to receive the activity datatherefrom and access the memory 12. In some aspects, the memory 12 isembedded in the host 11.

The host 11 includes a processor, e.g., a central processing unit (CPU)or a microcontroller unit (MCU), to perform a member identification (ID)of one of the multiple family members who enters or leaves the house,and access the correspondence relationship in the memory 12 according tothe member ID of staying members or the entering/leaving member amongthe multiple family members to accordingly control on/off of theplurality of control switches 141 to 14N thereby achieving the purposeof controlling home appliances.

For example, when the sensor 13 is an image sensor, the host 11 performsthe face recognition according to the image frame to recognize a memberID of a entering or leaving member. The face recognition is performed byconventional face recognition algorithm as long as the facial featuresor parameters of every family member are recorded in a setting phase.The facial features or parameters of every family member are recorded inthe memory 12 or on the cloud. When the image sensor is arranged at anentrance of the house, the host 11 recognizes the member ID when onefamily member passes the entrance and then changes setting of the stateindication in the memory 12 corresponding to a passing member, e.g.,from 1 to 0 or from 0 to 1, to indicate a state change of the passingmember. The host 11 then controls the plurality of control switches 141to 14N according to a state of the passing member or a combination ofstates of the staying members (i.e. members at home) or absent members(i.e. members not at home).

For example, when one family member leaves the house, all homeappliances in the bedroom thereof are turned off and a leaving state isoptionally shown on a display screen of the input device 15. Forexample, when only elders and children are left in the home, the windowat balcony and the gas valve are turned off and the indoor camera or thethermal sensor are turned on.

For example, when the sensor 13 is an audio sensor, the host 11 performsvoiceprint recognition according to the acquired voice data to recognizea member ID of an entering/leaving member and performs a naturallanguage processing (NLP) to identify a proceeding direction thereof.For example, the host 11 is embedded with conversation function suchthat it is able to identify whether a family member is entering orleaving the house according to a dialogue with the family member toaccordingly control the corresponding control switch set. Theconversation function is implemented by the trained model and parametersintegrated in the host 11, or by coupling a commercial intelligent voicedevice or smart speaker (e.g., used as an input device) with the host 11without particular limitations.

In other aspects, the sensor 13 includes two or more than two sensors,e.g., including both an image sensor and an audio sensor. The host 11recognizes a member ID according to the image frame and identifies aproceeding direction thereof using the NLP, or vice versa.

In some aspects, the host 11 is further connected to a network 18 toreceive positioning signals of multiple family members via the network18. The network 18 includes, for example, at least a wireless network ora local network. The position signals are provided, for example, by thepositioning system of a mobile/wearable device 19 (e.g., a smart phoneor smart bracelet, but not limited to) and sent to the host 11 via thenetwork 18. In one aspect, the host 11 identifies a leaving (or absent)member and a staying member according to the positioning signals. In oneaspect, the host 11 identifies a family member with the positioningsignals thereof entering a predetermined range (e.g., going home withina short time) of the host 11 as an expected staying member, i.e., anumber of staying members going to increase. The host 11 accesses thecorrespondence relationship in the memory 12 according to both thestaying member and the expected staying member to control the pluralityof control switches 141 to 14N, e.g., previously turning on or turningup the air conditioner, windows or water heater. This aspect isespecially suitable to the case that there is no one at home, i.e. anumber of staying members being zero.

Referring to FIG. 3, it is a schematic block diagram of a smart homecontrol system 300 according to a second embodiment of the presentdisclosure. The smart home control system 300 includes a host 31, amemory 32, a plurality of sensors (two sensors being shown herein, butnot limited to), an electronic calendar 34, an input device 35 and aninforming device 36. In some aspects, the electronic calendar 34 isedited via the input device 35 or a mobile/wearable device 39. In otheraspects, the electronic calendar 34 is an individual electronic deviceand has its own input interface.

The memory 32 includes volatile memory and/or non-volatile memory, andis used to record multiple agenda including at least one of, forexample, purchasing objects, people contact, paying bills, carryingobjects, and proceeding positions, wherein the multiple agenda occur atidentical or different times to be recorded by the smart home controlsystem 300. Each of the multiple agenda is recorded by an item codehaving multiple bits. The item code includes, for example, at least oneof a member bit, a category bit, a temporal bit and a position bit.

The member bit (shown as people in FIG. 3) is used to indicate or mark afamily member (or member ID) who is suitable to execute an agendum. Forexample, if a digital value of the member bit is “1”, it means that theassociated agendum is suitable to be executed by a male member; if adigital value of the member bit is “0”, it means that the associatedagendum is suitable to be executed by a female or young member; and ifthe member bit is a null-bit (shown as N in FIG. 3), it means that theassociated agendum is suitable to be executed by any family member.

In some aspects, one agendum is suitable to be executed or not executedby a family member according to more than one bit, e.g., executed by anadult and male member (e.g., the member bit having two bits, one forindicating an adult or not, and the other one for indicating a malemember or not), or suitable to executed or not executed by more than onefamily member, e.g., not executed by an elder and a child. That is, oneagendum has multiple limitations of family members indicated by themember bit.

In some aspects, one agendum is set to be executed based on a priorityof family member, e.g., the member bit having another bit for indicatingor defining the priority associated with one agendum. If the familymember having a higher priority is not able to execute one agendum(e.g., due to the indication of other bits as mentioned below), said oneagendum is automatically changed to the family member having a lowerpriority. In some aspects, the priority is set by more than one bits,e.g., one bit for indicating male and one bit for indicating adult; onebit for indicating female and one bit for indicating adult. In otheraspects, the priority is indicated or defined by the temporal bit asbelow. That is, the member bit includes multiple bits respectively usedto indicate different features of every family member.

The category bit (shown as affair in FIG. 3) is used to indicate or marka type of an agendum including, for example, the purchasing objects,people contact, paying bills, carrying objects, proceeding positions(shown as I₁ to I₃ in FIG. 3, but not limited to) as mentioned above.The type of an agendum may be set and changed by family member(s) viathe input device 35 or preset in the smart home control system 300.

The temporal bit (shown as time in FIG. 3) is used to indicate or markan execution interval or priority of an agendum. For example, if adigital value of the temporal bit is “1”, (show as I in FIG. 3) it meansthat the associated agendum is a normal level and it is not necessary toaccomplish this agendum in a hurry. In this case, when a family memberassociated with a current event does not match this agendum (illustratedby an example below), the family member is not informed to execute thisagendum. However, if a digital value of the temporal bit is “10” (showas II in FIG. 3), it means that the associated agendum is an emergency.In this case, even when a family member associated with a current eventdoes not match this agendum, the family member is still informed toexecute this agendum. For example, if one agendum is set to be executedby a male member but when the temporal bit of the one agendum isindicated as an emergency, this agendum is still informed to otherfamily members. In some aspects, even though a current agendum isindicated as an emergency, the current agendum is never informed to aspecific member, e.g., never noticing a kid or elder, but not limitedthereto. That is, some agenda are always set to be executed or notexecuted by a specific family member.

Besides, if a digital value of the temporal bit is “11” (show as III inFIG. 3), it means that the associated agendum is preferably executed atmorning; and other digital values of the temporal bit are used toindicate that the associated agendum is preferably executed in otherinterval of a day, e.g., in the afternoon or at night. That is, thetemporal bit includes more than one bit to indicate different features,e.g., priority and suitable interval, of the agenda if required.

The position bit (shown as spot in FIG. 3) is used to indicate or markan execution position of an agendum, e.g., convenient store,supermarket, restaurant, book store, friend's home (shown as A to C inFIG. 3, but not limited to). That is, different digital values of theposition bit are used to indicate different positions of one agendum.

In some aspects, as long as the category bit of one agendum isdetermined, the corresponding member bit, temporal bit and spot bit aredetermined. In the present disclosure, one agendum is suitable to beexecuted by more than one family member, within more than one intervaland/or at more than one position.

It is appreciated that a bit number of the item code (Ic) is determinedaccording to the information needed to indicate.

In another aspect, the smart home control system 300 includes multipleregisters to respectively indicate the item code including the memberbit, the category bit, the temporal bit and the position bit. That is,the host 31 sets the item code by setting the state of the multipleregisters.

The smart home control system 300 sets the item code of agenda accordingto detection results of the plurality of sensors 331, 332 . . . . Insome aspects, the sensor is embedded in a smart home appliance, e.g., ina smart refrigerator or a smart lamp device. The smart refrigerator isintegrated with multiple sensors used to detect storage amount of goodsand the detected result is sent to the host 31 after the smartrefrigerator is coupled to the host 31. In other aspects, the sensor isarranged as individual CCD image sensors, CMOS image sensors, thermalsensors, audio sensors, radio sensors (e.g., RFID) or the like.

The host 31 is selected from various fixed or movable computers thathave calculating ability, e.g., a personal computer, desktop computer,notebook computer, tablet computer, security server or the like withoutparticular limitations. The host 31 is coupled (wired or wireless) tothe memory 32 and the plurality of sensors 331, 332 . . . to give a newitem code of a new agendum detected by one of the plurality of sensors,and the new item code is recorded in the memory 32. For example, when asmart refrigerator detects that the egg is run out or when a smart lampdevice detects that a lamp is burn-out, a signal is sent to the host 31.The host 31 takes this signal as a new agendum, and gives, for example,the member bit as N, the category bit as shopping (e.g., I₁), thetemporal bit as I (e.g., normal item), and the position bit assupermarket (e.g., A) as a new item code to be recorded.

In some aspects, the host 31 further compares (in a bit-by-bit manner)the correlation or similarity of a new item code of a new agendum withthe item codes of the recorded multiple agenda (i.e. the existed agenda)to confirm whether to combine or link (e.g., to be informed together)the new agendum to one of the existed agenda. For example, when themember bit, category bit, temporal bit and position bit of a new agendumare fully identical to the item code of one existed agendum or a list ofexisted agenda, the host 31 combines or links the new agendum to theexisted agendum or the list of existed agenda to improve the operationefficiency.

In some aspects, if one bit of a new item code of a new agendum is setas “Null”, the one bit of the new item code is similar or correlated toa corresponding bit of any recorded item code, i.e. null-bit having nolimitation and having a lowest priority. Accordingly, if the new agendumis combined or linked to one recorded agendum that has limited itemcode, e.g., limited to be executed by a specific member, within aspecific interval or at a specific spot, the new agendum (originallyhaving null-bit) is then limited to be executed by the same limitationas the recorded agendum to which the new agendum is combined or linked,i.e. null-bit being changed to be the same as the recorded agendum.

In other words, the host 31 monitors the happening in the house via aplurality of sensors 331, 332 . . . and sequentially gives a codethereto to be recorded in the memory 32 as the agenda. Besides, anagendum may be known by checking the electronic calendar 34. Forexample, if one family member edited an appointment with someday in theelectronic calendar 34, after checking the electronic calendar 34, thehost 31 takes this appointment as a new agendum and gives an item code(including bits of people, affair, time and spot as shown in FIG. 3)thereof to be recorded in the memory 32. The recorded agendum isinformed to the associated family member at the someday.

When recognizing a current event, the host 31 gives an event code (Ec)of the current event, and then compares the event code with the recordedmultiple item codes (Ic) to determine related agenda of the currentevent among the existed multiple agenda. For comparing with the itemcodes, the current event is also preferably indicated by people, affair,time and spot, e.g., the event code includes at least one of an eventmember bit, an event category bit, an event temporal bit and an eventposition bit corresponding to the item bits. Similarly, in one aspect,the event member bit, the event category bit, the event temporal bit andthe event position bit are indicated by multiple registers.

The comparing is to confirm whether the corresponding bits areidentical. When digital values of every bit or register indication ofthe item code of one agendum are totally or partially (e.g., bit havinghigh priority as mentioned above) identical to those of the event code,the agendum is considered as a related agendum (i.e. item code and eventcode matching). In the comparing procedure, the host 31 stores thegenerated event code into the memory 32 at first and then compares withthe existed item codes, or the host 32 directly compares the generatedevent code with the existed item codes and the event code is thencancelled after the comparison. As mentioned above, in the comparingprocedure, if one bit of the item code or the event code is indicated orgiven as “Null”, the null-bit is similar or correlated to thecorresponding bit.

In the present disclosure, the current event is an event triggered by aperson, e.g., including family member leaving and family member having aphone call, but not limited thereto. As long as an event triggered by aperson may be linked to deal with an existed agendum at the same time,this event is considered as a current event herein.

In one aspect, it is assumed that the sensor 331 is an image sensor. Thehost 31 recognizes a member ID according to image frames captured by theimage sensor (e.g., face recognition mentioned above) and identifieswhether the associated family member goes out or not, e.g., according tothe proceeding direction of the member image. When the host 31identifies a specific member leaving the house, an event code of aleaving event is given. For example, the event member bit is set as adigital value indicating a male member (and an ID if there are more thanone male members in the family), the digital value of the event categorybit is set by recognizing the dressing (e.g., wearing sportswear) of themale member, and the digital value of the event temporal bit is setaccording to his leaving time. If it is not able to define the eventposition bit, the event position bit is set as null-bit, or theproceeding position is identified using other ways (illustrated by anexample below).

When the host 31 identifies that the leaving event has related agenda,the informing device 36 is used to inform the related agenda of thecurrent event. The informing device 36 includes a mobile device, adisplay screen or a dialogue system. The host 31 informs, via theinforming device 36, the leaving member such related agenda regardingthe goods to be purchased, positions to proceed and items to be carried.

In another aspect, it is assumed that the sensor 332 is an audio sensor.The host 31 recognizes a member ID according to the voice data acquiredby the audio sensor (e.g., by the voiceprint as mentioned above) andidentifies whether the associated member is having a phone call (e.g.,by NLP as mentioned above). After the host 31 identifies a member ID whois on the phone, an event code of a calling event is given. For example,the event member bit indicates an ID of a family member who is havingthe phone call, the event category bit indicates a phone call, the eventtemporal bit indicates a calling time zone, and the event position bitindicates at home.

In the present disclosure, when the host 31 is not able to identify afeature of any bit of the member bit, the category bit, the temporal bitor the position bit, the bit is set as null-bit. In comparison, thenull-bit matches (e.g., correlated with or similar to as mentionedabove) any digital value of a corresponding bit.

When identifying that the calling event has related agenda, the host 31informs the related agenda of the current event using the informingdevice 36, e.g., the content to tell the person at the other side of thephone.

Similarly, the host 31 identifies and sets digital values of every bitof a current event according to the detection results of more than onesensor, e.g., performing the face recognition according to the imageframe and confirming the heading position or activity according to thevoice data.

In other aspects, the host 31 determines every bit of the event code ofa current event according to the daily schedule. For example, one of thefamily members goes to the same position or has the same activity everyday or someday of a week, the host 31 sets the event code of a leavingevent when identifying the family member goes out at that specific time.The host 31 then actively compares the event code with the accumulatedmultiple item codes of multiple agenda to confirm the related agenda.The daily schedule is set by the family member via the input device 35or actively identified according to the feedback of the mobile/wearabledevice 39.

In other aspects, the host 3 is used to determine the event codeaccording to the content of the electronic calendar 34. For example,when recognizing that one family member is going out (e.g., according tothe image frame or voice data), the host 31 retrieves the proceedingposition and purpose by checking the electronic calendar 34 toaccordingly set the digital values of every bit of the event code to becompared with the recorded item codes.

The position bits of the item code and/or the event code may also be setaccording to the historical paths of a family member. For example,shops, restaurants or addresses passed by when the family member goes toor comes back from the job position are used to set the position bit.That is, the position bit is not set according to a single position. Forexample, the smart home control system 300 is connected to a network 38to receive positioning signals of the family members via the network 38.The positioning signals are generated, for example, by themobile/wearable device 39 of the family members and transmitted to thehost 31 via the network 38. In this way, the host 31 determines thedigital values of the position bits of the item code and/or the eventcode according to the historical paths of the positioning signals. Forexample, if one family member will pass some specific positions in theway to and from the job position, the host 31 indicates the position bitof an agendum to include multiple passed positions. When detecting thatthe family member goes to work, the host 31 takes the agendum as arelated agendum of the going to work event. It should be mentioned thatalthough the historical paths are illustrated by the job position, thepresent disclosure is not limited thereto. The historical paths aredetermined according to any position that a family member goesfrequently.

In this embodiment, after the host 31 informs a related agendum usingthe informing device 36, the informed agendum is not immediately removedfrom the list of recorded multiple agenda. When one agendum is confirmedto be accomplished by one of the plurality of sensors (e.g., new eggsbeing put in the case, new lamp being exchanged), by the audio sensor,by the electronic calendar 34 or by input of the input device 35, thehost 31 then removes the accomplished agendum from the list of recordedmultiple agenda.

The item code and/or the event code may be changed or set via a humanmachine interface of the input device 35, wherein the input device 35includes, for example, at least one of a mouse device, a keyboard, ajoystick, a screen, a microphone and a touch device. When the inputdevice 35 is coupled to the host 31, the host 31 executes thecorresponding control and gives the response based on the installedsoftware and/or hardware. In some aspects, all or a part of the inputdevice 35 is integrated in the host 31.

Referring to FIG. 4, it is a flow chart of an operating method of asmart home control system 300 according to a second embodiment of thepresent disclosure. The operating method includes: confirming a leavingfamily member (Step S41); setting an event code (Step S42); checkingrelated agenda of the event code (Step S43); informing the relatedagenda to the leaving family number (Step S44); and confirming whetherthe related agenda is accomplished or not (Step S45). In thisembodiment, the current event is illustrated by a leaving event as anexample. As mentioned above, the current event may be other eventstriggered by a person. Referring to FIGS. 3-4 together, details of oneexample of this operating method are illustrated below.

Step S41: Before the occurring of a current event, it is assumed thatthe memory 32 has previously recorded at least one agendum. As mentionedabove, the agendum is detected by the sensors 331, 332 . . . , confirmedfrom the electronic calendar 34, or inputted via the input device 35.The host 31 detects the current event via the sensors 331, 332 . . . ,e.g., a family member going out, and the detecting method has beenillustrated above and thus are not repeated. When the host 31 istriggered by the current event, the Step S42 is entered.

Step S42: The host 31 sets the event code, including changing thedigital value or register states, of the current event according to thedetection results of the sensors or information from other peripheraldevices (e.g., electronic calendar 34 or input device 35). As mentionedabove, the host 31 may or may not store the generated event code intothe memory 32.

Step S43: Next, the host 31 checks whether the existed agenda have anyrelated agendum of the event code. As mentioned above, the host 31checks the related agenda by comparing the event code with every itemcode. It is appreciated that if the memory 32 does not record anyagendum, the comparing is not performed.

Step S44: If the memory 32 does contain the related agendum of the eventcode of the current event, the host 31 uses the informing device 36 orthe mobile/wearable device 39 to notify the event member to execute therelated agendum. If the agenda in the memory 32 do not match (correlatedor similar) the event code (e.g., more than a predetermined number ofcorresponding bits having different digital values), the recorded agendaare not informed to the current event member and awaiting to be executedby other family members.

Step S45: Finally, when the host 31 receives a message indicating thatone agendum is accomplished, e.g., from the sensor 331, 332 . . . ,electronic calendar 34, the input device 35 and/or mobile/wearabledevice 39, the accomplished agendum is cancelled or removed from thememory 32.

In a third embodiment, the host 31 further identifies whether a notifiedor assigned related agendum in the Step S44 is forgotten or unable to beexecuted by a leaving member (e.g., detected by the multiple sensors331, 332 . . . as mentioned above) according to the detection result ofan external sensor, and rearranges the related agendum, includingreassigning, rescheduling and/or re-notifying. In the third embodiment,the detecting sensor is called “external sensor” to be distinguishedfrom the multiple sensors 331, 332 . . . arranged in the house asmentioned above. The operation of the third embodiment is alsoimplemented using the smart home control system 300 in FIG. 3.

It should be mentioned that a type of the external sensor in the thirdembodiment may be identical to the type of some sensors in the secondembodiment, and the difference is in the position of performingdetection. Taking the mobile/wearable device 39 as an example, when themobile/wearable device 39 of one family member is operated before thefamily member leaves the house, the mobile/wearable device 39 is belongto the multiple sensors in the second embodiment; whereas, when themobile/wearable device 39 of one family member is operated after thefamily member leaves the house, the mobile/wearable device 39 is belongto the external sensor in the third embodiment. That is, in the secondembodiment, the detection is mainly performed indoor; whereas, in thethird embodiment, the assigned related agendum is rearranged accordingto the detection result of the external (or outdoor) sensor.

Please referring to FIG. 5, it is a flow chart of an operating method ofa smart home control system 300 according to a third embodiment of thepresent disclosure, including the steps of: assigning a related agendumof a leaving family member (Step S44′); detecting the related agendumnot being executed using an external sensor (Step S51); and rearrangingthe related agendum (Step S53), wherein the related agendum not beingexecuted includes the related agendum being forgotten to be executed bythe leaving family member or being unable to be executed due to otherreasons without particular limitations.

In one aspect, FIG. 5 follows the Steps S41 to S43 in FIG. 4. When thememory 32 includes the related agendum of an event code of a leavingevent (i.e. current event) as checked in the Step S43, the host 31updates an assign bit of the related agendum to indicate that therelated agendum has been assigned to one family member for execution,wherein details of the Steps S41 to S43 are referred to the abovedescriptions in the second embodiment and thus not repeated herein. Whenthe host 31 confirms that the memory 32 includes a related agendum of anevent code of a leaving event, both the Steps S44 and S44′ areperformed. In addition, the method of detecting an agendum and recordingthe member bit, the category bit, the temporal bit and the position bitof an item code of the agendum is identical to the second embodimentmentioned above, and thus details thereof are not repeated herein.

For example FIG. 3 shows that the item code Ic further includes anassign bit. When one agendum is not related or assigned to any familymember, the assign bit thereof is set to 0 (e.g., as in initialsetting); whereas, when one agendum is related or assigned to one familymember, the assign bit thereof is changed to 1. Similarly, the assignbit is indicated using a register as another example. In another aspect,the assign bit includes more than one bit to further indicate the ID ofan assigned or related specific family member. That is, the assign bitis used to indicate whether each agendum is assigned as a relatedagendum of one event and/or one family member.

Step S44′: When one family member leaving the house is detected, thehost 31 checks whether the leaving family member has a related agendumin the memory 32, and the identifying method has been described in thesecond embodiment. When the host 31 identifies that the leaving familymember has a related agendum, the host 31 updates an assign bit of therelated agendum, e.g., changing from 0 to 1, but not limited thereto.

Step S51: During the time interval that the family member is not athome, the host 31 identifies whether the related agendum is performed ornot according to the detection result of any external sensor.

In one aspect, the external sensor is an image sensor of themobile/wearable device 39 of a leaving family member. The host 31 isconnected to the network 38 to receive image frames of the image sensorof the mobile/wearable device 39 of the leaving family member via thenetwork 38. The host 31 identifies whether the related agendum isexecuted according to the received image frames. For example, when theimage frames received via the network 38 indicate that it is raining andthe leaving family member is not driving a car, the host 31 identifiesthat the leaving family member is not able to execute the relatedagendum and thus actively rearranges the related agendum (Step S53).Various scenarios that indicate a related agendum unable to be executedare set previously in the host 31, and the scenarios identifiable by thehost 31 according to the image frames are implemented by a model trainedusing the machine learning based on, for example, convolutional neuralnetwork.

In other aspects, the image sensor is not limited to be arranged on themobile/wearable device 39, but a vehicle camera is used.

In another aspect, the external sensor is a positioning device of themobile/wearable device 39 of a leaving family member. As mentionedabove, in one aspect the related agendum is determined according to ahistorical path of the leaving family member. Accordingly, the host 31identifies whether the related agendum is executable according to acurrent path of the leaving family member. For example, the host 31 isconnected to the network 38 to receive positioning signals of thepositioning device of the mobile/wearable device 39 of the leavingfamily member via the network 38. The host 31 identifies whether therelated agendum is executed according to the current path of thepositioning signals. For example referring to FIG. 6, the host 31identifies that the historical path of the leaving family member fromhome to office is the path A. When the host 31 receives positioningsignals of the mobile/wearable device 39 that indicate that the leavingfamily member is taking the path B to the office, the host 31 activelyrearranges the related agendum (Step S53). The host 31 starts torearrange the related agendum when the leaving family member is still inthe path B, or after the leaving family member reaches the office.

In another aspect, when the host 31 receives internet informationindicating that the path A is blocked, the host 31 actively rearrangesthe related agendum.

In other aspects, the positioning device is not limited to be arrangedon the mobile/wearable device 39, but a vehicle positioning device isused.

In another aspect, the host 31 is connected to the payment system of astore (e.g., supermarket or convenience store, but not limited to) orthe cloud for storing receipts. Accordingly, the external system is thescanner of a cash register or an indoor scanner that scans image codesor RFID tags on the product packaging. The host 31 is connected to thenetwork 38 to receive a shopping list of the leaving family member viathe network 38 (e.g., download from the payment system, themobile/wearable device 39 or cloud). The host 31 identifies whether therelated agendum is executed according to the shopping list. When thehost 31 identifies that the shopping list does not include any productcontained in the related agendum, the host 31 actively rearranges therelated agendum (Step S53).

In another aspect, the host 31 is connected to the network 38 to receivestore service time information via the network 38. The host 31identifies whether the related agendum is executable according to thereceived store service time information. In this aspect, the externalsensor, e.g., the mobile/wearable device 39, detects the setting of thehomepage or social media of a store where the leaving family member isexpected to go. When the host 31 identifies that the time at which theleaving family member reaches the store will exceed the store servicetime, the host 31 actively rearranges the related agendum (Step S53).

In the present disclosure, the host 31 identifies whether the relatedagendum can be accomplished or not according to data or information fromany external sensor (e.g., including various personal, public andcommercial sensors) so as to actively respond to the executing state ofthe related agendum.

It should be mentioned that although the third embodiment is describedusing shopping, the present disclosure is not limited thereto. Therelated agendum of the third embodiment also includes people contact,paying bills and proceeding positions as mentioned above as long as thehost 31 is coupled to, via the network 38, external sensors to receivedata or information (e.g., positioning signals, image frames or websitedata) that indicates a related agendum unable or forgotten to beaccomplished. The host 31 then rearranges the related agendum.

In the third embodiment, said rearranging includes reassigning a currentrelated agendum (e.g., updating the assign bit and checking whether thecurrent related agendum is suitable to be executed by other familymembers using the Steps of FIG. 4), rescheduling a current relatedagendum (e.g., rescheduling the current related agendum to be executedby the same family member at another day or another spot) andre-notifying a current related agendum (e.g., reminding the same familymember regarding the current related agendum again using the informingdevice 36 and/or the mobile/wearable device 39).

After rearranging the related agendum, the host 31 further notifies thefamily member who is originally assigned to execute the related agendumusing the informing device 36 or the mobile/wearable device 39.

It should be mentioned that although the second embodiment isillustrated in a way that one family member is about to go out, thepresent disclosure is not limited thereto. In other aspects, if thememory 32 has not recorded any agendum when one family member passes theentrance to go out, the smart home control system 300 still takes theabsent event as a current event, and gives an event code (Ec) of theabsent event to be recorded in the memory 32 when recognizing the absentevent. If a new agendum occurs (e.g., detected by one of the pluralityof sensors) when the family member is still outside, the host 31 gives anew item code to the new agendum and compares the new item code with therecorded event code to determine whether the new agendum is a relatedagendum of the recorded absent event. If the agendum is confirmed as arelated agendum, the host 31 informs the outdoor member via the network38 to execute the new agendum. However, if the new agendum is not arelated agendum, the host 31 accumulates the new agendum in the memory32 waiting to be informed to other family members, e.g., informed whendetecting a leaving event of another family member as an example in thesecond embodiment mentioned above. Whether the new agendum is a relatedagendum is identified, for example, according to the correlation orsimilarity between the new item code and the recorded event code asmentioned above.

In one aspect, the informed family member can refuse to execute therelated agendum, e.g. using the input device 35 or the mobile/wearabledevice 39 to send a refuse signal. In this case, the host 31continuously holds the agendum waiting to be informed to other familymembers (in the case the agendum being suitable to be executed by morethan one family member). In the case that the related agendum is set tobe executed only by the informed family member, the host 31 replies thatthe related agendum cannot be refused.

In the smart home control system of the present disclosure, the memoryfurther stores software and/or the host is embedded with hardware orfirmware used in operation of the above first and second embodiments.

The smart home control system of the present disclosure further helpsthe family member to search a specific object (e.g., cellphone, keys).For example, the family member tells the smart home control system thespecific object to be searched via a smart audio assistant. The hostlocates the specific object by the image recognition and then informsthe family member through the informing device, e.g., showing on adisplay screen or playing by a speaker.

The smart home control system of the present disclosure further activelyreminds a leaving member to bring an umbrella or regarding the weatherat the time the family member is about to go out if the raining and hightemperature information is obtained from the internet.

The smart home control system of the present disclosure further activelyinforms, via the mobile/wearable device, the family member to deal withthe situation of unclosed stove fire when there is nobody at home.Furthermore, when a fire scene is monitored, the smart home controlsystem actively contacts the local fire brigade.

The smart home control system of the present disclosure furthermonitors, e.g., by analyzing captured images, the food being eaten bythe family member. When it is detected that any family member is aboutto eat allergenic food, an alarm is provided by the host via theinforming device.

The smart home control system of the present disclosure furthermonitors, e.g., by analyzing captured images, the fragment or fluid onthe floor. When the fragment or fluid are detected, a cleaning robot isautomatically informed to perform the cleaning job or family members areinformed via the informing device or the mobile/wearable device by thehost.

The smart home control system of the present disclosure furthermonitors, e.g., by analyzing captured images or thermal images, thephysical discomfort of family members. For example, if the fever,falling or abnormal behavior is detected, other family members areinformed by the host via the informing device or the mobile/wearabledevice. If the unusual situation is continuously not eliminated, amedical institution is contacted.

The smart home control system of the present disclosure further performsthe environment control. For example, if the low room temperature,holding tightly the bed sheet or sneeze is detected, e.g., by analyzingcaptured images or thermal images, the temperature setting is increased.In this case, the controlled device is coupled to the host.

Although the above embodiments are illustrated by multiple familymembers as an example, the present disclosure is not limited thereto.The smart home control system of the present disclosure is furtheradaptable to the house having a single member and the control procedureis much easier. Meanwhile, the family member adapted to trigger oractivate the smart home control system may be set or changed using theinput device or the mobile/wearable device.

Since both the first and second embodiments perform the correspondingfunction by detecting the entering and leaving of a person, they arecombinable to operate together. For example, when detecting the enteringand leaving of a family member, the host controls the conducting stateof the control switches and prompt the related agendum. In addition,although the above embodiments are illustrated in the way that the hostperforms the automatic control according to the detection results, thecontent in the memory may also be set and changed by a family memberusing the mobile/wearable device via the network.

As mentioned above, in a smart home it is preferably to performdifferent controls corresponding to different family members andautomatically give a hint to a leaving member of an agendum regardingrelated people, affair, time, spot and object to extend the controllablerange. Accordingly, the present disclosure further provides a smart homecontrol system (e.g. FIGS. 1 and 3) and an operating method (e.g. FIG.4) thereof that perform the indoor automatic control or remind a familymember to execute agenda according to the control method and agendastored in the memory when a host detects the entering and leaving of afamily member.

Although the disclosure has been explained in relation to its preferredembodiment, it is not used to limit the disclosure. It is to beunderstood that many other possible modifications and variations can bemade by those skilled in the art without departing from the spirit andscope of the disclosure as hereinafter claimed.

What is claimed is:
 1. A smart home control system, comprising: a memoryconfigured to record multiple agenda each being recorded using an itemcode comprising a member bit, a category bit, a temporal bit, a positionbit and an assign bit; multiple sensors; and a host, coupled to thememory and the multiple sensors, and configured to give a new item codeof a new agendum to be added in the memory when one of the multiplesensors detects the new agendum, give an event code of a leaving eventwhen the leaving event is recognized, compare the event code withrecorded multiple item codes to determine a related agendum of theleaving event among the multiple agenda and update the assign bit of therelated agendum, and rearrange the related agendum when identifying,according to an external sensor, that the related agendum is notexecuted.
 2. The smart home control system as claimed in claim 1,wherein the host is further configured to compare correlation betweenthe new item code of the new agendum and the recorded multiple itemcodes of the multiple agenda to determine whether to combine or link thenew agendum to one of the multiple agenda.
 3. The smart home controlsystem as claimed in claim 1, wherein the event code comprises at leastone of an event member bit, an event category bit, an event temporal bitand an event position bit.
 4. The smart home control system as claimedin claim 3, wherein one of the multiple sensors is an image sensor, andthe host is configured to give the event member bit, the event categorybit, the event temporal bit and the event position bit of the event codeof the leaving event according to image frames acquired by the imagesensor.
 5. The smart home control system as claimed in claim 3, whereinone of the multiple sensors is an audio sensor, and the host isconfigured to give the event member bit, the event category bit, theevent temporal bit and the event position bit of the event code of theleaving event according to voice data acquired by the audio sensor. 6.The smart home control system as claimed in claim 3, wherein the host isfurther configured to give the event member bit, the event category bit,the event temporal bit and the event position bit of the event code ofthe leaving event according to a daily schedule.
 7. The smart homecontrol system as claimed in claim 3, further comprising an electroniccalendar, wherein the host is further configured to determine at leastone of the event code and the item code according to content of theelectronic calendar.
 8. The smart home control system as claimed inclaim 1, wherein the rearranging is to reassign, reschedule or re-notifythe related agendum.
 9. The smart home control system as claimed inclaim 1, wherein the assign bit is configured to indicate whether eachagendum is assigned as a related agendum of one event.
 10. The smarthome control system as claimed in claim 1, wherein the host is furtherconnected to a network to receive image frames of an image sensor of amobile/wearable device of an assigned family member associated with theleaving event via the network, and the host is further configured toidentify whether the related agendum is executed according to the imageframes.
 11. The smart home control system as claimed in claim 1, whereinthe host is further connected to a network to receive positioningsignals of a mobile/wearable device of an assigned family memberassociated with the leaving event via the network, and the host isfurther configured to identify whether the related agendum is executedaccording to a current path of the positioning signals.
 12. The smarthome control system as claimed in claim 1, wherein the host is furtherconnected to a network to receive a shopping list of an assigned familymember associated with the leaving event via the network, and the hostis further configured to identify whether the related agendum isexecuted according to the shopping list.
 13. The smart home controlsystem as claimed in claim 1, wherein the host is further connected to anetwork to receive store service time information via the network, andthe host is further configured to identify whether the related agendumis executed according to the store service time information.
 14. A smarthome control system, comprising: a memory configured to record multipleagenda each being recorded using an item code comprising a member bit, acategory bit, a temporal bit, a position bit and an assign bit; multiplesensors; and a host, coupled to the memory and the multiple sensors, andconfigured to give an event code of a leaving event when the leavingevent is recognized according to one of the multiple sensors, comparethe event code with recorded multiple item codes to determine a relatedagendum of the leaving event among the multiple agenda and update theassign bit of the related agendum, and rearrange the related agendumwhen identifying, according to an external sensor, that the relatedagendum is not executed.
 15. The smart home control system as claimed inclaim 14, wherein the rearranging is to reassign, reschedule orre-notify the related agendum.
 16. The smart home control system asclaimed in claim 14, wherein the assign bit is configured to indicatewhether each agendum is assigned as a related agendum of one event. 17.The smart home control system as claimed in claim 14, wherein the hostis further connected to a network to receive positioning signals of amobile/wearable device of an assigned family member associated with theleaving event via the network, and the host is further configured toidentify whether the related agendum is executed according to a currentpath of the positioning signals.
 18. The smart home control system asclaimed in claim 14, wherein the host is further connected to a networkto receive a shopping list of an assigned family member associated withthe leaving event via the network, and the host is further configured toidentify whether the related agendum is executed according to theshopping list.
 19. The smart home control system as claimed in claim 14,wherein the host is further connected to a network to receive storeservice time information via the network, and the host is furtherconfigured to identify whether the related agendum is executed accordingto the store service time information.
 20. The smart home control systemas claimed in claim 14, wherein the host is further connected to anetwork to receive image frames of an image sensor of a mobile/wearabledevice of an assigned family member associated with the leaving eventvia the network, and the host is further configured to identify whetherthe related agendum is executed according to the image frames.